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DETAILED ACTION 



1 . This action is responsive to communications: Amendment A, formal drawings, and IDS 
all filed 3/31/2003. 

2. Claims 1-27 are pending in the case. Claims 1, 7, 10 5 13, 20 and 25 are independent 
claims. 

3. Claims 1-23 remain rejected over the prior art. New claims 24-27 stand rejected. 

4. Applicant's arguments, with respect to rejections make under Section 1 12, 2 nd paragraph 
have been fully considered and are persuasive. The rejection of claims 1-6 has been withdrawn. 



5. The text of those sections of Title 35, U.S. Code not included in this action can be found 
in a prior Office action. 

6. Claims 10-12 and 25-27 are rejected under 35 U.S.C. 101 because the claimed invention 
is directed to non-functional descriptive data stored on a medium. 



7. Claims 1-12 and 25-27 remain rejected under 35 U.S.C. 103(a) as being 
unpatentable over "Synchronized Multimedia Integration Language (SMIL) 1.0 
Specification," W3C Recommendation 15-June-1998, herein referred to as W3C, in view of 
deVries et al. (USPN 6332144— (priority date 3/11/1998). 

Regarding independent claim 1, W3C discloses a system (p.26, ex. 4) for associating 
annotations, contained in the <text . . . /> tag, to the plurality of media streams, representing 
different versions of multimedia content, that would be contained in ellipses found at lines 6, 9, 
and 12 of the example, as explained in the header of the example. While there is no explicit 



Claim Rejections - 35 USC § 101 



Claim Rejections - 35 USC § 103 



+ 
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mention of annotations and multimedia servers, W3C does however disclose that both the 
annotations and media are referenced by a URI (p. 19, "src"), which were well-known to refer to 
servers. deVries et al. (deVries) discloses that media and annotations can be stored on servers 
(FIG IB, 22 and 26), the annotation server inherently having a database of annotations. 
Therefore it would have been obvious to one of ordinary skill in the art at the time of the 
invention to combine deVries and W3C in order to effectively store the annotations, media, and 
relations between the two. 

Regarding dependent claim 2, deVries discloses the streams can be audio or video (col. 1, 11. 



Regarding dependent claim 3, W3C discloses different time compressed versions (p. 26, ex. 2). 
Regarding dependent claim 4, W3C discloses versions having different resolutions (p. 26, ex. 



Regarding dependent claim 5, W3C discloses an identifier for each of the plurality of media 
streams (p. 19, "src"). 

Regarding dependent claim 6, W3C discloses the identifier is a URI (p. 19, "src") equivalent to 



Regarding independent claim 7, W3C discloses an SMIL document that correlates an 
annotation with different versions of the same multimedia content as described in the rejection of 
claim 1 . It is the position of the Office that a data structure is equivalent to an XML document 
such as a SMIL. W3C does not disclose storing the annotation. deVries discloses a storage 
device to store the annotation (FIG. IB, 26). It would have been obvious to combine deVries 



59-61). 



4). 



a URL. 
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and W3C to store the annotation so that it is correlated through the data structure by storing the 
annotation in the storage device at the location referenced by the URI in the <text/> tag. 
Regarding dependent claim 8, W3C discloses a version list identifying multiple different 
versions (p.26, ex. 4). 

Regarding independent claims 10 and 25, W3C teaches a data field representing an annotation 
corresponding to multimedia content, and a data field correlated so that the field identifies a 
plurality of different versions of the multimedia content to which the annotation corresponds 
(p.26, ex. 4). 

Regarding dependent claims 11 and 26, W3C teaches that identifiers are intended to be 
included at the ellipses in example 4, on page 26. 

Regarding dependent claim 9, 12, and 27, W3C teaches that URI's, equivalent to URL's are 
intended to be included at the ellipses in example 4, on page 26. 
8. Claims 13-20, and 22-24 remain rejected under 35 U.S.C. 103(a) as being 
unpatentable over W3C in view of Klemets et al. (USPN 6449653— field 3/25/1997) herein 
referred to as Klemets. 

Regarding independent claim 13, W3C teaches associating an annotation with a set of media 
streams, however, is silent as to the creation of the annotations. Klemets teaches receiving a user 
request to create a new annotation (col. 5, 11. 52-67). It would have been obvious to one of 
ordinary skill in the art at the time of the invention to include a method of creating a new 
annotation, as it would be allow easier addition of annotations. 

Regarding dependent claim 14, W3C does not explicitly disclose associating a new record with 
a previously generated record. W3C does disclose annotations in <par> and <seq> tags (sees. 
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4.2.1 -.4. 1.2). Upon the creation of new annotation as recited in claim 13, it would have been 
obvious to one of ordinary skill in the art at the time of the invention to associate the annotation 
within the tags to allow the annotation to be synched with the media stream. 
Regarding dependent claim 15, it would have been inherent to identify the streams before 
associating anything with them. 

Regarding dependent claim 16, Klemets discloses a streaming media server, where the media 
is located (col. 4, 11. 36-54). In order to identify the media, there must be communication with 
server. 

Regarding dependent claim 17, W3C discloses a set of identifiers, each identifier uniquely 
identifying one of the sets of streams (p.26, ex. 4). 

Regarding dependent claim 18, W3C discloses a record of the set of media streams (p.26, 
ex.4). It would have been obvious to one of ordinary skill in the art at the time of the invention 
to generate and store this record so that it can be read later. 

Regarding dependent claim 24, W3C is silent on providing annotations to a user. Klemets 
discloses providing the annotations to the user together with a set of one media stream (col. 8, 11. 
26-34). It would have been obvious to one of ordinary skill in the art at the time of the invention 
to combine W3C and Klemets as the markup language of W3C was intended to describe how 
media should interact with each other when it is displayed. 

Regarding independent claim 20, W3C discloses receiving an indication of the version of 
media content (p. 18, 11 1-3). W3C also discloses that annotations are corresponding to a 
plurality of different versions of the media content, (p. 26, ex. 4). W3C is silent on providing the 
annotations to he the user. Klemets discloses providing the annotations to the user (col. 8, 11. 26- 




Application/Control Number: 09/396,984 



Page 6 



Art Unit: 2176 

34). It would have been obvious to one of ordinary skill in the art at the time of the invention to 
combine W3C and Klemets as the markup language of W3C was intended to describe how 
media should interact with each other when it is displayed. 

Regarding dependent claim 22, while neither Klemets nor W3C explicitly teach comparing 
identifiers, it would have been obvious to one of ordinary skill in the art at the time of the 
invention to compare the identifiers to find out what media the version was a part of. 
Regarding dependent claims 19 and 23, the computer programs for executing the methods of 
claims 13 and 20 are rejected under the same rationale. 

9. Claim 21 remains rejected under 35 U.S.C. 103(a) as being unpatentable over W3C 
and Klemets as applied to claim 20 above, and further in view of Media Weaver, by Sha 
Xin Wei (6/2/1997). 

Regarding dependent claim 21, Klemets discloses playing an annotation at the proper time 
(col. 8, 11 59-67). Both W3C and Klemets are silent as to converting media. Xei discloses 
converting media (p. 12 bullet 3). It would have been obvious to one of ordinary skill in the art at 
the time of the invention modify Xei into W3C and Klemets so that the annotations would still 
be presented in the same context as in the original media. 



10. Applicant's arguments filed 3/31/03 have been fully considered but they are not 
persuasive. 

Regarding Applicant's remarks under 35 USC 101: ^^^^^ 

While Applicant is claiming a "data structure" in the preamble, the body of the claim merely 
recites a collection of fields. Use of the broad phrase "correlated through" is insufficient to 



Response to Arguments 



+ 
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establish the necessary functional interrelationship between elements to constitute a true data 
structure. As such, the claims recite non-functional descriptive data stored on a medium. 
Regarding Applicant's remarks on p.14 regarding claim 1: 

Applicant argues that the text tag does not qualify as annotations. The Office disagrees. The 
text is contained with a <par> tag (§ 4.2.1), with the <switch> block. Within the switch block, as 
noticed in the example's text, are "alternative parts designed for screens with different 
resoulutions, and bit-depths." The ellipses at 6, 9, and 12, are clearly meant to be the alternative 
parts. These are the different versions of multimedia content. They would be represented by one 
of the tags disclosed in §4.2.3. Both those tags, and <text> when contained within a <par> can 
be associated to particular time frames (p. 12). While W3C indeed does not make mention of the 
word "annotation," it is still the position of the Office, that text associated with media is an 
annotation. The title of section that Applicant points out is referring to the elements within the 
switch. The ellipses within the text tag do not only indicate that the source is arbitrary, but also 
that any attribute could be contained within, such as the ones listed in §4.2.3. 
Regarding dependent claim Applicant's remarks regarding claims 10, 13, and 20,. 
The claims are considered to be not persuasive, as they argue similar points that the Office has 
addressed regarding claim 1 above. 



1 1 . The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. USPN 6571295 to Sidana. 



Conclusion 
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12. Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Adam M Queler whose telephone number is (703) 308-5213. 
The examiner can normally be reached on Monday-Friday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Heather R Herndon can be reached on (703) 308-5186. The fax phone numbers for 
the organization where this application or proceeding is assigned are (703) 746-7239 for regular 
communications and (703) 746-7238 for After Final communications. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the receptionist whose telephone number is (703) 306-5631. 
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